Adaptive synchronization of dynamics on evolving complex networks 
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We study the problem of synchronizing a general complex network by means of an adaptive 
strategy in the case where the network topology is slowly time varying and every node receives at 
each time only one aggregate signal from the set of its neighbors. We introduce an appropriately 
defined potential that each node seeks to minimize in order to reach/ maintain synchronization. We 
show that our strategy is effective in tracking synchronization as well as in achieving synchronization 
when appropriate conditions are met. 



In recent years synchronization of large networks of 
interconnected systems has been the subject of intense 
investigation. In [l| it was shown that, under the as- 
sumption that all the systems are identical and the cou- 
pling among the connected systems is of a suitable type, 
the stability of the synchronous evolution can be investi- 
gated by means of a 'master stability function' approach. 
Many papers have followed the approach in [l[ , focusing 
on the way the network topology impacts the stability 
of the synchronous evolution e.g., reviewed in Q. 
An adaptive synchronization approach to obtaining esti- 
mates of unknown system parameters has been pursued 
in a number of recent papers 0]. In Q it was shown 
that an adaptive strategy acting on the strengths of the 
network couplings, based on information about the dy- 
namics at its nodes, can be effective in enhancing the 
stability of the synchronous state. Here we will present 
an adaptive approach to synchronize a time varying net- 
work that evolves under the effects of exogenous (unpre- 
dictable) factors. 

The formulation of many past works on network syn- 
chronization of identical systems (see [lj and the related 
literature) typically involves coupling to a node i from 
other network nodes j through a term of the form 



(1) 



where A+j is the weighed NxN network adjacency matrix 
representing the strength of the coupling from j to i, 
(An — 0), Xi(t) is the n-dimensional state at node i, 
H : R™ — > R™, and the network has N nodes, {i,j} = 
1, 2, N. For the purposes of our approach, we think of 
the first term in ([T]) as a directly accessible physical signal 
received by node i from other nodes in the network, and 
we denote this signal 



s l (t) = Y J A l3 H(x ] {t)). 



(2) 



The second term in ([TJ results in the convenient property 
that the coupling becomes zero when synchronization is 
achieved; i.e., when 



x\{t) = x 2 (t) 



x N (t) = x s (t). 



(3) 



In order to implement a coupling of the form of fT]). the 
external information required at node i is the received 
signal Si(t), as well as the sum of the input coupling 
strengths, J2i Aij- Here we will be concerned with situa- 
tions in which the only available external information at 
node i is the signal s i (t) , and direct knowledge of . Aij 
is unavailable. Thus synchronization must be achieved 
on the basis of Si(t) only. In order to accomplish this, 
we will propose and test a simple adaptive strategy. We 
will also present numerical experiments that show that 
our adaptive strategy can, under appropriate conditions, 
be effective in synchronizing the network. 

Consideration of this problem has both technological 
and biological motivation. For example, as a technologi- 
cal motivation, we consider a networked system in which 
dynamical units (e.g., chaotic oscillators) are located on 
autonomous moving platforms (nodes) and communicate 
by wireless. The signal received by each platform is the 
weighed sum of the signals (represented by H(xj)) sent 
from other platforms, where the weights represent the 
spreading and attenuation of these signals along their 
propagation paths (represented by Aij). If at each plat- 
form i there is no available information on the individual 
locations, attenuations, etc., associated with the input 
from other platforms, then the adaptation of a node to 
changes in the network due to motion of the platforms 
must be accomplished solely on the basis of the aggre- 
gate signal © that it receives. In the biological context, 
we note that synchronism is often observed in circum- 
stances of changing environments and states of the con- 
sidered organism (e.g., the ability to synchronize is evi- 
dently evolved as an organism develops, and persists with 
changes due to disease, etc.). In both the above techno- 
logical example, as well as possible biological examples, 
in order to maintain overall system synchronism, nodes 
must adjust the processing of inputs they receive from 
the network based only on aggregate information avail- 
able to them. Furthermore, in both the technological 
and biological contexts, we envision that synchronous dy- 
namics on which the node states Xi(t) evolve is typically 
much faster than the time scale over which the network 
changes. Thus, we say that the network changes 'slowly' 
in time, and we will make use of this supposed slowness 
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in what follows. To emphasize this, we will sometimes 
write the adjacency matrix as Aij(t) instead of A^j. We 
consider network dynamical equations of the following 
form, 

±i (t) = F{ Xi (*)) +<n (t) Si (t) -jH( Xi (*)) , i = 1 , 2, . .. , N, 

(4) 

where the equation for the evolution of aij(t) in the ab- 
sence of coupling is ii(t) = F(xi{t)) with F : R™ — > R™, 
Si(t) is the input signal at node i defined in Eq. ([2]), 
and 7 is a constant gain equal for all the nodes in the 
network. 

A synchronous dynamical solution ([3]) exists for ai(t) 
equal to 

^(t) = 7 /X>;(<)- (5) 

j 

When the condition 

ffi(i) - *<(<) (6) 
is satisfied, Eq. (H]) can be rewritten as 

i<(t) =F(ii(t)) +7^A J (t) J H"(^(t)), (7) 
where the N x N matrix C(t) — {Cij(t)} is such that 

Cu = -l vi, AiW = Ej^M*). for 1 ^ J 

and thus has the property that the sum of the elements 
in each row is zero. Thus, assuming synchronization, 
x\{t) — X2{t) = ... = xisr(t) = x s (t), the last term in 
([7]) is identically zero and the synchronization dynamics 
is governed by the same dynamics as for an individual 
uncoupled system, 



x s (t) =F(x s (t)). 



(8) 



In this situation, the arguments of the master stability 
function theory of Ref. [1] apply and the stability of the 
synchronous evolution depends essentially on the choice 
of an appropriate coupling 7. When Oi(t) is not given by 
([5]), then Eq. ([7]) does not in general admit a synchronous 
solution. 

In what follows we will attempt to program the time 
evolution of <Xj(i) so that it tends to relax toward <7j(t), 
and we will proceed under the assumption that, for 
the chosen value of 7, the synchronized state is stable 
for <Ji = (jj. In order to motivate our programming 
technique, we first define a mean squared exponentially 
weighed synchronization error at each node i, 



A<(t) 



- v ( t -^\a i (t')s i (t , )- 7 H(x i (t'))\ 2 dt', (9) 



where v~ x is the temporal extent over which the averag- 
ing is performed. Thus when synchronization is achieved 
(i.e., Xi = x a and crj = <ii for all i), we have that A, = 
and Aj > otherwise. Hence we will attempt to pro- 
gram <Ji(t) to minimize Aj. This is greatly facilitated if 
we choose v so that 



t s < v < TJV, 



(10) 



where t s is the time scale on which the node dynamics 
evolves (e.g., the time scale for the evolution of Xi(t)), 
and tjv is the time scale on which the network evolves 
(i.e., the time scale on which Aij(t) and hence <7j(i) 
change). With this assumption, Oi(t') in ([9]) can be re- 
placed by <Ti(t) to yield the following approximation to 
A,, 



A«(t) = o?(t)£i(i) - 2 7 <T i (t)C i (t) + 7 2 A(i), (11) 



where 



B l {t) 



-v{t-t') 2 



(t')dt', 



(12) 



Ci(t)= e-^-t'hiit') ■ H(xi(t'))dt' ; (13) 



Di(t) = J , 



-v(t-t') 



{H{ Xl {t'))) 2 dt'. 



(14) 



Since Aj = at synchronization and is positive oth- 
erwise, one option is to program (Tj(t) so as to seek the 
minimum of Aj by the following gradient descent relax- 
ation, 



d/Ji (t) 
dt 



-ct^ = -2a(a i B i - 7 C i ), (15) 
da,. 



where a is a parameter that determines the relaxation 
time scale and Aj(crj) may be viewed as a potential func- 
tion for the gradient flow (IT5|) . To eliminate the need for 
calculating the integrals (Tj"2"|) and (|13[) at each time step, 
we note that Bi and Cj satisfy the following first order 
differential equations, 



dBj(t) 
dt 



= -vBi- 



dC t {t) 
dt 



= -vC i + s i -H{x i ). (16) 



Thus our adaptive strategy is described by the set of 
differential equations (|4I11[ [T6|l . 

In order to test the above described strategy we have 
performed a series of numerical experiments that we now 
describe. In our initial experiments, we consider a ran- 
dom network of N nodes and < k > N/2 links, where 
< k > is the network average degree. At t = we as- 
sume that the adjacency matrix is Ajj(0) = Ajj(0) = 1 if 
a link exists between i and j, and Ay(0) = otherwise. 
For t > we assume the following network evolution, 



Aij(t) = Ay-(0)(1 + eij sm{uijt)), 



(17) 



where the ejj are random numbers drawn from a uni- 
form distribution between and 1 and the u>ij are ran- 
dom numbers drawn from a uniform distribution between 



> and u n 



> Mr, 



where t n = (uj max ) 1 is 



much longer than the characteristic time scale of the dy- 
namics at the network nodes r s . 



3 



As an example, we consider a network of cou- 
pled Rossler oscillators, Xj = (aiji, x&, xa) 7 ' and 
F(xi) = [—I® - x ia ;xu + 0.1653;^; 0.2 + (x. a - lO)^]. 
We choose the oscillators to be linearly coupled in 
the xn variable, i.e., H(x) — Hx, where H 
1 0: 0; 0]. We have also investi- 
gated other choices for H (x) and obtained similar results. 

Here, for the sake of simplicity, we assume that the 
dynamics of the adaptation process (| 1 5|) is fast. Thus 
taking a — > 00, we have that <n(t) rapidly converges to 
"iCi{t) /Bi(t), where the dynamics of Bi(t) and Ci(t) are 
given by §TE§, and in place of (fTTj) we use 



Ci(t) 

Bitty 



(18) 



We have found that the value of the parameter v as 
well as the initial conditions on d and Bi can signifi- 
cantly impact the network behavior. With respect to the 
initialization of Ci and Bi we emphasize that, while it 
may be physically difficult to initialize the variables Xi 
in a prescribed way, in contrast, initializations of Bi and 
Ci can be freely specified, because Bi and Ci are inter- 
nal variables that we use only in computing our adap- 
tive changes. Assuming that Aij (0) is known, we set 

d{0) = Bi(0)(£j ^y(O))" 1 10 satisf y ©■ We would like 
to choose Bi(0) in such a way that, if our system con- 
sisting of Eqs. ([H [T5|) has attractors other than the 
desired synchronism tracking solution (Aij(t) « Aij(t)), 
then these other spurious attractors do not capture the 
orbit. To promote this we wish to choose the -By(O) so 
that the initial condition is likely to be in the basin of 
attraction of our desired solution. To this end, we as- 
sume that we are in a synchronized state and average 
the first of Eqs. (16) for Bi(t) over the chaotic oscilla- 
tions thus yielding Bi ~< sf >. Noting the definition 
^ of Si and our choice H (x) = (x, 0, 0) T for our exam- 
ple we have < sf >~< k 2 >< x 2 sl > t , where < k 2 > 
is the second moment of the network degree distribution 
and < x 2 sl >t denotes a time average of x s i(t) for the 
synchronous chaotic dynamics, Eq. ([8]). Thus we choose 



Bi(0) 



-< k 2 >< x 2 sl 



>t, 



(19) 



which yields for the example in Fig. 1, Bi(0) « 10 4 . 

As a first experiment, we have sought to track the syn- 
chronous evolution for the evolving network, with the 
adaptive strategy described above. We started from 
an initial condition in which all the oscillators are in 



the same state, xn(0) = x®,Xi2(0) 



,x i3 (0) 



^3) 

2 = 1, ...,N, where x° = (xi, x°, x^) T is a randomly cho- 
sen point belonging to the Rossler attractor and ct^(0) = 
<7j(0), i — 1, ...N, with Bi(0) given by (fTi?|) at each node 
i. We considered a network of N = 50 nodes and average 
degree < k >= 10. We took 7 = 2 so as to ensure the 
stability of the synchronous evolution in the case where 
the Aij are constant in time, Aij — Ay(0). We assumed 
v = 1/(2t s ), where we took r s to be the time at which 
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FIG. 1: The plots show the time evolutions from t = to 
t — 100 of xu(t),i = 1, .., N, while the network topology 
evolves according to (|17|l in the case where the adaptation 
1 )161 1181) was implemented (a) and in the case where it was 
not implemented (b). Here the oscillators start synchronized, 
v — 1/(2t 3 ), 7 = 2. The network parameters are as follows: 
N = 50, < k>= 10. 



the autocorrelation function of x s (t) obtained from nu- 
merical solution of (|8|) becomes 0.5, t s ~ 0.7. The net- 
work topology was evolved as in (TIT)) , with w m ;„ = 0.01 
and Umax = 0.02. Fig. [TJa) shows superposed plots of 
the time evolutions of xn(t),i = 1,..,N from t = to 
t = 100 for a case in which adaptation was implemented. 
We see from this figure that all the N = 50 solutions 
evolve almost identically. Furthermore, their behavior is 
as described by the solution of the uncoupled chaotic dy- 
namics, Eq. ijHJ. In contrast, Fig. QJb) shows the same 
example but for the case in which adaption was not im- 
plemented (i.e., <7j(i) = <7j(0) for all time). In this case 
a synchronized solution obeying Eq. ([8|) is not attained, 
and after the network has significantly evolved (t > 40) 
there is appreciable spread amongst the Xi at different 
network nodes. 

For the above experiment we found that the results 
were robust to changes in Bi(0) from its nominal value 
of 10 4 obtained from Eq. (19); e.g., using Bi(0) = 1 gave 
essentially the same results. As we will see from our next 
numerical experiments, this is not always the case. Fig. 
1 shows that the proposed adaptive strategy technique 
is effective for tracking an initially synchronous state. 
In what follows, we address the 'global synchronization' 
problem for the network (|4|), i.e., we consider initial con- 
ditions, which can be far from the synchronization man- 
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FIG. 2: E xt calculated between ii = 500 and t<i = 1000, vs 
c; N = 100, < fc>= 20, ^ = l/(2r s ), 7 = 2, Bi(0) = 1. The 
dashed line represents E X1 vs c for the case Bi(0) = 3 x 10 4 . 

ifold ([2]). Indeed, in real situations it may often not be 
feasible to initialize with near identical states Xi(0) on 
each node. In order to evaluate the effects of initial con- 
ditions Xi(0) that differ from node to node, we consider 
initializing the network as follows, 

x ii = x\+cpit ix , x° 2 = x%+cp 2 e iy , x% = aj3+cp 3 |e iz |, 

where (x®, x^, x\) is a randomly chosen point on the 
Rossler attractor; ti X , €i y and ti Z are zero-mean indepen- 
dent random numbers of unit variance drawn from a nor- 
mal distribution; p\ — 7A5,p 2 = 7.08, ps = 4.25 are the 
standard deviations of the time evolutions of the states 
x s ,y s , z s from numerical solution of ([5]) (calculated over a 
long time evolution); and c is a parameter characterizing 
the degree to which the initial conditions vary from node 
to node. We define an average synchronization error E Xl 
for the evolution of the variables xu(t) (z = 1,2,..., N) 

E X1 = M( , 1 - ; / 2 E l^ 1 (*) " ®\ dt > ( 21 ) 
N(t 2 -ti)p 1 J tl 

where xn(t) = iV -1 J2iLi x n(t) and Pi — < ( x si~ < 
x s i >t) 2 >t^ 2 , where < ... > t indicates the time average 
and the subscript s denotes evolution of x — (xi,X2, X3) T 
in the synchronous state (i.e., using dynamics from Eq. 



[8]). As shown by the dashed line in Fig. 2, obtained with 
Bi(0) ~3x 10 4 , given by (flUj) . we achieve good synchro- 
nization of the evolving adaptive network. In order to see 
the effect of an arbitrary less rational choice of Bi(0) we 
have repeated this experiment using Bi(0) — 1. The solid 
line in Fig. H shows E Xl , with {t 1 ,t 2 ) = (500, 1000), ver- 
sus c, for Bi(Q) = 1. It is seen that as c increases above 
about 0.2, the network fails to synchronize. In contrast, 
with Bi(0) from (|19p . synchronization was achieved for 
any value of the parameter c between and 1, thus il- 
lustrating the impact of properly choosing the initial Bi 
value. This is because, when the node states are not ini- 
tialized closely enough, the network trajectories may be 
attracted by another attractor of the dynamical system 
(I4I16I18|) , that is different from the synchronous attractor 

©■ 

Finally, we have also tested the robustness of our 
scheme to deviations of the individual systems from iden- 
ticality. To this end, we replace F(xi) in Eq. ^ by 
Fi(xi) = [-x i2 - x i3 ;x n + 0.165(1 + A<50;0.2 + (x a - 
10)2^3], where for each node i the parameter Si is chosen 
randomly with uniform density in the interval [—1, 1] and 
repeat our original experiment (the experiment resulting 
in Fig. 1). The parameter A characterizes the degree of 
non-identicality of the node dynamical systems (A = 
for Figs. 1 and 2). Our results show, for example, that 
for A < 0.2, the synchronization error is less than 4%, 
i.e., E Xl < 0.04, thus indicating that good results may 
still be obtained when the coupled systems deviate from 
being precisely identical. 

In conclusion, we have shown that an adaptive strat- 
egy can be used for the tracking of synchronization of 
time evolving network systems whose network evolution 
is unknown at the nodes of the network. We have also 
evaluated the effects of variable initial conditions at the 
network nodes, and observed that global synchronization 
may be achieved if the initial conditions of the adap- 
tive variables (J3i(0), Ci(0)) are chosen appropriately, i.e., 
from the basin of attraction of (|4I16I18[) . Preliminary nu- 
merical experiments have shown the effectiveness of our 
proposed strategy in yielding approximate synchroniza- 
tion also for networks of non- identical systems. 
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